Journal of Machine Learning Research) ??-?? Submitted; Revised; PublishedEfficient Online and Batch Learning using Forward Backward Splitting

Source URL: stanford.edu

• Mathematical optimization
• Convex analysis
• Convex optimization
• Subgradient method
• Gradient descent
• Lipschitz continuity
• Subderivative
• Support vector machine

A Variational Analysis of Stochastic Gradient Algorithms Stephan Mandt , Matthew D. Hoffman , David M. Blei 1 2

Source URL: www.stephanmandt.com

• Estimation theory
• Statistical theory
• Econometrics
• M-estimators
• Stochastic processes
• Loss function
• OrnsteinUhlenbeck process
• Stochastic gradient descent
• Likelihood function

Chapter 4 O verf itt ing Avoi dance i n Regressi on Trees This chapter describes several approaches that try to avoid overfitting of the training data with too complex trees. In the context of tree-based models these str

Source URL: www.dcc.fc.up.pt

• Decision trees
• Pruning
• Decision tree learning
• Regression analysis
• Gradient boosting

Rectified Factor Networks

Source URL: www.bioinf.jku.at

• Computational statistics
• Machine learning
• Computational biology
• Sepp Hochreiter
• Artificial neural networks
• Computational neuroscience
• Deep learning
• Autoencoder
• Principal component analysis
• Normal distribution
• Stochastic gradient descent
• Support vector machine

GeNGA: A Generalization of Natural Gradient Ascent with Positive and Negative Convergence Results Philip S. Thomas School of Computer Science, University of Massachusetts, Amherst, MAUSA

Source URL: psthomas.com

• Differential geometry
• Fourier analysis
• Multivariable calculus
• Gradient descent
• Metric tensor
• Multiplier
• Directional derivative
• Mathematical optimization
• Fisher information

Rectified Factor Networks Supplement Djork-Arn´e Clevert, Andreas Mayr, Thomas Unterthiner and Sepp Hochreiter Institute of Bioinformatics, Johannes Kepler University, Linz, Austria {okko,mayr,unterthiner,hochreit}@bioi

Source URL: www.bioinf.jku.at

• Linear algebra
• Functional analysis
• Projection
• Mathematical optimization
• Expectationmaximization algorithm
• Gradient descent
• Matrix

The Condition of a System of Linear Equations: Alternative Derivation Roland Angst Computer Vision and Geometry Lab, Eidgenössische Technische Hochschule Zürich Zürich, Switzerland

Source URL: cvg.ethz.ch

• Numerical linear algebra
• Numerical analysis
• Condition number
• Matrices
• Matrix
• Inequality
• Residual
• Least squares
• Conjugate gradient method
• Linear least squares

Topmoumoute online natural gradient algorithm Nicolas Le Roux University of Montreal Pierre-Antoine Manzagol

Source URL: nicolas.le-roux.name

• Mathematics
• Numerical analysis
• Algebra
• Computational statistics
• Stochastic optimization
• Linear filters
• Numerical linear algebra
• Convex optimization
• Stochastic gradient descent
• Gradient descent
• Artificial neural network
• Mathematical optimization

Weighted SGD for ?𝓅 Regression with Randomized Preconditioning

Source URL: www.stat.berkeley.edu

• Operations research
• Econometrics
• Convex optimization
• Numerical linear algebra
• Estimation theory
• Preconditioner
• Support vector machine
• Linear regression
• Gradient descent
• Regression analysis
• Stochastic gradient descent
• Linear programming

TOPICS IN GEOMETRIC ANALYSIS: MAXIMUM PRINCIPLES, REFINED KATO INEQUALITIES, AND GRADIENT ESTIMATES OF HARMONIC FUNCTIONS AND EIGENFUNCTIONS OF THE LAPLACIAN DANIEL J. F. FOX Contents

Source URL: 138.100.100.254